CLAIMS 

1. An image interpolating device comprising: 

a color filter having a first row, in which red (R) and green (G) 
color filter elements are alternately aligned in the horizontal 
direction, and a second row, in which G and blue(B) color filter 
elements are alternately aligned in the horizontal direction, said 
second row being adjacent to the upper or lower side of said first 
row; 

an imaging device that generates first R, G, and B-signals 
which are pixel signals corresponding to said color filter 
elements ; 

a pattern-setting processor that extracts images belonging 
to a first pattern, in which a pixel having said first R-signal 
is positioned at the upper-left corner of a 2 x 2 pixel matrix, 
a second pattern, in which a pixel having said first G-signal is 
positioned at the upper-right corner of said 2x2 pixel matrix, 
a third pattern, in which a pixel having said first G-signal is 
positioned at the lower-left corner of said 2x2 pixel matrix, 
and a fourth pattern, in which a pixel having said first B-signal 
is positioned at the lower-right corner of said 2x2 pixel matrix, 
f romsaidf irstR, G, andB-signals generatedby said imaging device; 

a G-interpolati on processor that, regarding first and fourth 
objective pixels contained in said images belonging to said first 
and fourth patterns, obtains a second G-signal by utilizing said 
first G-signals of pixels adjacent to said first or fourth objective 
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pixel ; 

an R/B-interpolation processor that, regarding second and 
third objective pixels contained in said images belonging to said 
second and third patterns, obtains second R and B-signals by 
5 utilizing said first R and B-signals of pixels adjacent to said 
second and third objective pixels; 

a first interpolation/modification processor that extracts 
a first similar pixel which has the closest luminance value to 
that of said first objective pixel, from pixels adjacent to said 
O 10 first objective pixel, obtains a third B-signal of said first 
objective pixel by a first interpolation process, and modifies 
said second G-signal of said first objective pixel , based on first 
information of said first similar pixel; and 

a second interpolation/modification processor that 
FU is extracts a second similar pixel which has the closest luminance 
value to that of said fourth objective pixel , from pixels adjacent 
to said fourth objective pixel, obtains a third R-signal of said 
fourth objective pixel by a second interpolation process, and 
modifies said second G-signal of said fourth objective pixel , based 
20 on second information of said second similar pixel. 

2 . Adevice according to claim 1 , wherein said first information 
comprises a luminance value and color difference signals Cb and 
Cr of said first similar pixel, and said second information 
comprises a luminance value and color difference signals Cb and 
25 Cr of said second similar pixel . 
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3 . A device according to claim 1 , wherein said first information 
comprises said first R-signal of said first objective pixel and 
color difference signals Cb and Cr of said first similar pixel, 
and said second information comprises said first B-signal of said 
fourth objective pixel and color difference signals Cb and Cr of 
said second similar pixel . 

4. A device according to claim 1, wherein said pixels, which 
are adjacent to said first and fourth objective pixels and which 
are utilized in said G-interpolation processor, are contained in 
said images belonging to said second and third patterns . 

5. A device according to claim 1, wherein said pixels, which 
are adjacent to said second and third objective pixels and which 
are utilized in said R/B-interpolation processor, are contained 
in said images belonging to said first and fourth patterns. 

6. A device according to claim 1, wherein said pixels, which 
are adjacent to said first and fourth objective pixels and which 
are utilized in both said first interpolation /modification 
processor and said second interpolation/modification processor, 
are contained in said images belonging to said second and third 
patterns . 

7. A device according to claim 1, wherein said first 
interpolation/modification processor and said second 
interpolation/modification processor respectively extract said 
first and second similar pixels, using said first G-signals of 
said pixels adjacent to said first and fourth objective pixels. 
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8. A device according to claim 1, wherein said first 
interpolation/modification processor obtains said third B-signal 
and modifies said second G-signal, on the assumption that said 
color difference signals Cb and Cr of said first objective pixel 
are equal to said color difference signals Cb and Cr of said first 
similar pixel. 

9. A device according to claim 1, wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, on the assumption that said 
color difference signals Cb and Cr of said fourth objective pixel 
are equal to said color difference signals Cb and Cr of said second 
similar pixel . 

10. A device according to claim 1, wherein said first 
interpolation/modification processor obtains said third B-signal 
and modifies said second G-signal, using said color difference 
signals Cb and Cr and a modified luminance value which is obtained 
by multiplying said luminance value by a ratio of said second 
G-signal of said first objective pixel and said first G-signal 
of said first similar pixel. 

11. A device according to claim 10, wherein said first 
interpolation/modification processor obtains said third B-signal 
and modifies said second G-signal, according to the following 
formula. 

YMD.299 x R<x* ,y')+0.587 x G (x ? ,y T ) +0 . 114 x B(x f ,y f ) 
Cb=-0.169 x R(x' ,y')-0.331 x G(x',y')+0.5 x B (x T , y f ) 



Cr=0.5 x R(x',y')-0.419 x G(x' ,y 1 ) -0 . 081 x B(x',y') 
YG=Y x G(x,y) /G(x\y') 
g'=YG-0.344 x Cb-0.714 x Cr 
b=YG+1.772 x Cb 

wherein Y is a luminance value of said first similar pixel, R(x' ,y') , 
GCx^y 1 )/ and B(x f ,Y f ) are said second R, first G, and second 
B-signals of said first similar pixel, G(x,y) is said second 
G-signal of said first objective pixel, b is said third B-signal 
obtained by said first interpolation/modification processor, and 
g 1 is said modified second G-signal. 

12 * A device according to claim 1 , wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, using said color difference 
signal Cr and a modified luminance value which is obtained by 
multiplying said luminance value by a ratio of said second G-signal 
of said fourth objective pixel and said first G-signal of said 
second similar pixel . 

13. A device according to claim 12, wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, according to the following 
formula . 

Y=0.299 x R(x f ,y f )+0.587 x G (x 1 ,y T )+0.114 x B(x',y f ) 
Cb=-0.169 x R(x f ,y')-0.331 x G(x\y')+0.S x B(x',y T ) 
Cr=0.5 x R(x f ,y')-0.419 x G (x ' ,y 1 ) -0 . 081 x B<x',y f ) 
YG=Y x G(x,y)/G(x T ,y f ) 
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r=YG+1.402 x Cr 
g*=YG-0.344 x Cb-0.714 x Cr 

wherein Y is a luminance value of said second similar pixel , R(x f ,y') , 
G(x',y'), and B(x',y') are said second R, first G, and second 
B-signals of said second similar pixel, G(x,y) is said second 
G-signal of said fourth objective pixel, r is said third R-signal 
obtained by said second interpolation/modification processor , and 
g' is said modified second G-signal. 

14. A device according to claim 1, wherein said first 
interpolation/modification processor extracts said first similar 
pixel, using said first G-signal and said second R-signal of said 
pixels adjacent to said first objective pixel. 

15. A device according to claim 1, wherein said second 
interpolation/modification processor extracts said second 
similar pixel , using said first G-signal and said second B-signal 
of said pixels adjacent to said fourth objective pixel. 

16. A device according to claim 1, wherein said first 
interpolation/modification processor obtains said third B-signal 
and modifies said second G-signal, using said color difference 
signal Cb and a modified luminance value which is obtained by 
multiplying said luminance value by a ratio of a first reference 
value, which is obtained based on said second G-signal and said 
first R-signal of said first objective pixel, and a second reference 
value, which is obtained based on said first G-signal and second 
R-signal of said first similar pixel . 
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17. A device according to claim 16, wherein said first 
interpolation/modification processor obtains said third B-signal 
and modifies said second G-signal, according to the following 
formula. 

Y=0.299 x R(x' ,y T )+0.587 x G(x' ,y T ) +0 . 114 x B(x f ,y T ) 
Cb=-0.169 x R(x f ,y f )-0.331 x G(x f ,Y T >+0.5 x B(x f ,yM 
Cr=0.5 x R(x T ,y T )-0.419 x G (x' ,y ' ) -0 . 081 x B(x',y') 
YG=Y x 

(0. 587 xG (x,y) +0. 299xR(x,y) )/ (0.587 xG(x' ,y 1 ) +0 .299xR(x' ,y') > 
g f =YG-0.344 x Cb-0.714 x Cr 
b=YG+1.772 x Cb 

wherein Y is a luminance value of said first similar pixel, R(x f ,y') , 
Gix 1 ,y') , and B(x f ,y') are said second R, first G, and second 
B-signals of said first similar pixel, G(x,y) is said second 
G-signal of said first objective pixel, b is said third B-signal 
obtained by said first interpolation/modification processor, and 
g f is said modified second G-signal. 

18. A device according to claim 1, wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, using said color difference 
signal Cr and a modified luminance value which is obtained by 
multiplying said luminance value by a ratio of a first reference 
value, which is obtained based on said second G-signal and said 
first B-signal of said fourth objective pixel, and a second 
reference value, which is obtained based on said first G-signal 
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and said second B-signal of said second similar pixel. 

19. A device according to claim 18, wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, according to the following 
formula. 

Y=0.299 x R(x T ,y T )+0.587 x G(x T ,y f ) +0 . 114 x B(x',y T ) 
Cb=-0.169 x R(x' ,y T ) -0.331 x G(x',y f )+0.5 x B(x',y f ) 
Cr=0.5 x R(x T ,y') -0.419 x G (x T ,y T ) -0 . 081 x B(x',y') 
YG=Y x 

(0. 587 xG(x,y)+0. 114 xB (x, y) )/ (0.587 xG(x' ,y f ) +0 . 114 xB (x' ,y') ) 
r=YG+1.402 x Cr 
g'=YG-0.344 x Cb-0.714 x Cr 

wherein Y is a luminance value of said second similar pixel , R(x f ,y T ) , 
GCx^y'), and B(x',y f ) are said second R, first G, and second 
B- signals of said second similar pixel, G(x,y) is said second 
G-signal of said fourth objective pixel, r is said third R-signal 
obtainedby said second interpolation/modification processor , and 
g T is said modified second G-signal. 

20. A device according to claim 1, wherein said first 
interpolation /modification processor obtains said third B-signal 
and modifies said second G-signal, according to the following 
formula . 

Cb=-0.169 x R(x» ,y f ) -0.331 x G(x f ,y T )+0.5 x BU^y 1 ) 
Cr=0.5 x R(x T ,y r )-0.419 x G(x f ,y T ) —0.081 x B(x',y f ) 
g'=1.443 x R(x,y)+0.443 x Cb-2.737 x Cr 
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b=1.293 x R(x,y)+2.293 x Cb-1.812 x Cr 

wherein R (x 1 ,y 1 ) , G<x',y'), andBJx 1 ^ 1 ) are said second R, first 
G, and second B-signals of said first similar pixel, R(x,y) is 
said first R-signal of said first objective pixel, b is said third 
5 B-signal obtained by said first interpolation/modification 
processor, and g T is said modified second G-signal. 
21. A device according to claim 1, wherein said second 
interpolation/modification processor obtains said third R-signal 
and modifies said second G-signal, according to the following 
n 10 formula. 

^555' 

Q 

in Cb=-0.169 x R(x' ,y')-0.331 x G(x',Y')+0.5 x B<x',y') 

Q 

*S Cr=0.5 x R(x' ,Y') -0.419 x G(x' ,y' ) -0 . 081 x B(x',y') 

^ r=0.773 x B(x,y) -1.773 x Cb+1.401 x Cr 

g '=1.116 x B(x,y)-2.116 x Cb-0.715 x Cr 

m 15 wherein R(x' ,y T ) , G(x f ,y T ) , andB(x T ,y T ) are said second R, first 

m 

fy G, and second B-signals of said second similar pixel, B(x,y) is 

said first B-signal of said fourth objective pixel , r is said third 
R-signal obtained by said second interpolation/modification 
processor, and g 1 is said modified second G-signal. 

20 22. An image interpolating device comprising: 

an imaging device that has a light receiving surface on which 
pixels are disposed in a matrix arrangement, a subject image being 
formed on said light receiving surface to generate first color 
signals corresponding to said subject image in said pixels; 

25 an interpolation processor that performs an interpolation 

46 



process, using said first color signals generated in a plurality 
of adjacent pixels positioned adjacent to an objective pixel, to 
obtain a second color signal of said objective pixel; and 

a modification processor that extracts a similar pixel which 
has the closest luminance value to that of said objective pixel, 
from pixels adjacent to said objective pixel, and modifies said 
second color signal of said objective pixel, based on a luminance 
value and color difference signals Cb and Cr of said similar pixel . 
23. An image interpolating device comprising: 

an imaging device that has a light receiving surface on which 
pixels are disposed in a matrix arrangement, a subject image being 
formed on said light receiving surface to generate first color 
signals corresponding to said subject image in said pixels; 

an interpolation processor that performs an interpolation 
process, using said first color signals generated in a plurality 
of adjacent pixels positioned adjacent to an objective pixel, to 
obtain a second color signal of said objective pixel; and 

a modification processor that extracts a similar pixel which 
has the closest luminance value to that of said objective pixel, 
from pixels adjacent to said objective pixel, and modifies said 
second color signal of said objective pixel , based on a color signal 
of said objective pixel and color difference signals Cb and Cr 
of said similar pixel . 
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